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An  Analysis  of  Efficiency  Testing  Under 

the  Energy  Policy  and  Conservation  Act:  A  Case  Study 

with  Application  to  Distribution  Transformers 


1     Introduction 


This  report  provides  analysis  of  the  protocols  for  effi- 
ciency testing  promulgated  by  10  CFR  Part  430  [1]  as 
established  under  the  Energy  Policy  and  Conservation 
Act  of  1975  (EPCA)  as  amended  [2],  and  proposed  for 
the  new  10  CFR  Part  432  [3].  Specifically,  the  perfor- 
mance of  these  testing  protocols  in  establishing  confor- 
mance with  a  rated  efficiency  or  a  rated  energy  use  is 
addressed.  The  case  of  distribution  transformers,  which 
are  covered  under  the  proposed  new  10  CFR  Part  432, 
is  discussed  in  detail.  This  discussion  includes  analysis 
of  existing  industry  standards  for  transformer  efficien- 
cies. These  results  are  presented,  in  part,  to  assess  the 
impact  of  EPCA  rule  making  on  the  transformer  indus- 
try. 

In  the  case  of  distribution  transformers,  laboratory 
measurements  of  efficiency  are  likely  to  be  used  for  two 
purposes:  1)  for  testing  of  compliance  with  a  rated  effi- 
ciency; and  2)  for  enforcement  testing.  The  objectives 
of  testing  for  each  of  these  purposes  differ  in  significant 
ways:  Compliance  testing  is  a  one-time  activity  un- 
dertaken at  the  initiation  of  the  program  or  upon  the 
introduction  of  a  covered  product,  while  enforcement 
testing  would  be  undertaken  when  the  performance  of 
a  specific  product  or  products  is  contested.  Enforce- 
ment testing  is  one  of  a  series  of  requirements  during 
an  enforcement  action. 

The  remainder  of  this  report  is  organized  as  follows: 
The  general  objectives  and  constraints  for  testing  un- 
der EPCA  are  discussed  in  Section  2.  Current  indus- 
try practice  regarding  efficiency  performance  and  ef- 
ficiency testing  is  reviewed  in  Section  3.  The  meth- 
ods and  model  assumptions  used  in  the  evaluation  of 
these  testing  protocols  are  presented  in  Section  4.  A 
discussion  of  the  sampling  plans  for  compliance  test- 
ing provided  in  10  CFR  Part  430,  the  proposed  new 
10  CFR  Part  432,  and  NEMA  Standard  TP  2  is  pre- 
sented in  Section  5.  The  Sampling  Plan  for  Enforce- 
ment Testing  established  by  10  CFR  Part  430  is  pre- 
sented in  Section  6.  For  the  convenience  of  the  reader, 
each  of  these  sampling  plans  are  provided  in  appen- 
dices to  this  report:  Appendix  A  contains  an  example 
sampling  plan  from  10  CFR  Part  430  and  the  proposed 
10  CFR  Part  432  sampling  plan  for  compliance  test- 
ing. Appendix  B  contains  the  sampling  plan  provided 


in  NEMA  Standard  TP  2.  A  Sampling  Plan  for  En- 
forcement Testing  which  is  adapted  form  that  provided 
in  10  CFR  Part  430  appears  in  appendix  C.  Finally, 
the  computational  algorithms  used  to  model  each  of 
these  sampling  plans  are  presented  in  appendix  D. 

It  should  be  emphasized  that  this  report  is  not  a  state- 
ment of  poUcy  by  the  U.S.  Department  of  Energy 
(DOE)  and  that  this  report  should  be  regarded  only 
as  commentary  on  these  testing  protocols.  DOE  con- 
tacts for  further  information  on  the  rule  making  for 
distribution  transformers  and  on  EPCA  legislation  are 
provided  in  Section  8. 


2     General  guidelines 

In  this  section,  we  summarize  briefly  the  general  objec- 
tives of  testing  under  EPCA.  This  material  is  included 
to  provide  ground  rules  for  evaluating  these  various 
sampling  plans. 

A  statement  of  purpose  for  the  EPCA  legislation  is 
given  in  42  U.S.C.  6312(a): 

It  is  the  purpose  of  this  Part  to  improve  the 
efficiency  of  electric  motors  and  pumps  and 
certain  other  industrial  equipment  in  order  to 
conserve  the  energy  resources  of  the  Nation. 

To  this  end,  EPCA  establishes  energy  performance 
standards  that  may  specify  acceptable  levels  of  effi- 
ciency or  energy  use  for  each  covered  product.  EPCA 
further  requires  that  any  represented  energy  perfor- 
mance be  accurate  in  42  U.S.C.  6314(d)(1): 

no  manufacturer,  distributor  retailer  or  pri- 
vate labeler  may  make  any  representation  — 

(A)  in  writing  (including  and  representation 
on  a  label),  or 

(B)  in  any  broadcast  advertisement, 

respecting  the  energy  consumption  of  such 
equipment  or  cost  of  energy  consumed  by  such 
equipment,  unless  such  equipment  has  been 
tested  in  accordance  with  such  test  procedure 
and  such  representation  fairly  discloses  the  re- 
sults of  such  testing. 
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EPCA  relies  on  a  program  of  systematic  testing  to  es- 
tablish that  these  performance  levels  are  met.  The 
objectives  and  limitations  of  testing  under  EPCA  are 
stated  in  42  U.S.C.  6314(a)(2): 

Test  procedures  prescribed  in  accordance  with 
this  section  shall  be  reasonably  designed  to 
produce  test  results  which  reflect  energy  effi- 
ciency, energy  use,  and  estimated  operating 
costs  of  a  type  of  industrial  equipment  (or 
class  thereof)  during  a  representative  average 
use  cycle  (as  determined  by  the  Secretary), 
and  shall  not  be  unduly  burdensome  to  con- 
duct. 

This  report  assumes  that  the  purpose  of  EPCA  is  sat- 
isfied if  the  average  efficiency  is  not  less  than  the  effi- 
ciency standard  established  under  EPCA  and  the  rated 
efficiency.  In  the  case  of  an  energy  use  standard,  this 
report  assumes  that  the  purpose  of  EPCA  is  satisfied 
if  the  average  energy  use  is  not  greater  than  the  energy 
use  standard  established  under  EPCA  and  the  rated 
energy  use. 

To  re-cap,  for  purposes  of  this  analysis,  we  assume 
that  the  performance  objectives  are  met  provided  that 
the  average  energy  efficiency  (energy  use)  is  not  less 
(greater)  than  the  EPCA  energy  performance  standard 
and  the  rated  value.  Compliance  with  a  rated  energy 
performance  is  established  under  EPCA  by  systematic 
testing;  and  EPCA  stipulates  that  testing  should  not 
be  unduly  burdensome  to  conduct.  For  the  purposes 
of  this  analysis,  two  criteria  are  considered:  1)  the  as- 
surance provided  by  a  sampling  plan  that  the  average 
performance  of  each  covered  product  meets  or  exceeds 
the  rated  performance,  and  2)  the  burden  placed  on 
industry  by  testing  under  that  sampling  plan. 


3     Industry  practice 

This  section  includes  a  brief  discussion  of  current  indus- 
try standards  for  distribution  transformers.  In  a  rule 
making,  it  may  be  useful  to  clarify  current  industry 
practice  and,  where  current  industry  practice  is  consis- 
tent with  the  purpose  of  EPCA,  to  harmonize  any  en- 
ergy performance  standards  established  under  EPCA 
with  these  practices. 

The  energy  efficiency  and  energy  consumption  of  distri- 
bution transformers  is  covered  by  two  standards  sanc- 
tioned by  the  National  Electrical  Manufacturers  Asso- 
ciation (NEMA):  NEMA  Standards  Pubhcation  TP  1- 
1996,  "Guide  for  Determining  Energy  Efficiency  for 
Distribution  Transformers"  [4]  and  by  NEMA  Stan- 
dards Publication  TP  2-1998  "Standard  Test  Method 


for  Measuring  the  Energy  Consumption  of  Distribu- 
tion Transformers"  [5].  The  efficiency  requirements 
for  NEMA  class-1  designation  are  established  in  sec- 
tion 4  of  the  NEMA  TP  1  standard,  which  applies  to 
both  liquid-filled  and  dry-type  distribution  transform- 
ers. The  NEMA  TP  1  Standard  establishes  "minimum 
efficiencies"  for  liquid-filled  and  dry-type  single-  and 
three-phase  transformers,  which  are  tabulated  tabu- 
lated in  Table  4-1  and  Table  4-2,  respectively.  Dry 
type  transformers  are  further  differentiated  by  their 
voltage  rating.  The  NEMA  standard  TP  1  tables  are 
reproduced  in  part  here  in  Tables  1  and  2,  respectively. 
NEMA  standard  TP  1  states  that  these  values  are  the 
"minimum  efficiencies"  for  transformers  designated  as 
NEMA  class  1.  For  purposes  of  this  discussion,  the 
phrase  "minimum  efficiencies"  will  refer  to  the  mini- 
mum average  efficiency  of  a  population.  NEMA  Stan- 
dard TP  2  [5]  section  7  provides  a  sampling  plan  de- 
signed to  establish  comphance  with  the  TP  1  efficien- 
cies. Section  7  of  the  TP  2  standard  is  included  in 
appendix  B  of  this  report  and  is  discussed  below  in 
section  5.2. 

Two  standards  sponsored  by  the  Institute  of  Electri- 
cal and  Electronics  Engineers  (IEEE)  are  also  relevant 
to  this  discussion:  ANSI  Standard  57.12.00-1993  [6], 
"General  Requirements  for  Liquid-Immersed  Distribu- 
tion, Power  and  Regulating  Transformers"  and  ANSI 
Standard  57.12.01,  "General  Requirements  for  Dry- 
Type  Distribution  and  Power  Transformers,  Includ- 
ing Those  with  Solid  Case  and/or  Resin-Encapsulated 
Windings"  [7] .  These  standards  cover  a  broad  range  of 
transformer  requirements,  including  recommended  tol- 
erances on  measured  losses:  under  these  standards,  the 
total  losses  of  a  single  unit  shall  not  exceed  106  percent 
of  the  rated  value,  and  the  average  loss  for  two  or  more 
transformers  shall  not  exceed  the  rated  value.  The  sec- 
ond requirement,  which  is  on  the  average  loss,  is  being 
debated  within  the  sponsoring  committee  and  may  be 
modified  or  deleted  in  future  versions  of  these  stan- 
dards. Since  the  measured  losses  are  directly  related 
to  the  efficiency,  these  standards,  in  effect,  establish  a 
tolerance  for  the  measured  efficiency  and  thus  provide 
a  level  of  quality  assurance  for  efficiency. 


4     Methods  of  analysis 

Two  figures-of-merit  provide  the  basis  for  the  evalua- 
tion of  these  testing  protocols:  the  operating  charac- 
teristic and  the  testing  burden.  The  operating  charac- 
teristic of  a  sampling  plan  is  the  probability  of  demon- 
strating compliance  when  testing  a  specific  distribution 
of  efficiencies  under  that  sampling  plan.  This  quantity 
provides  an  estimate  of  the  probability  or  risk  that  an 
acceptable  product  could  fail  by  chance  or  that  an  un- 
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Table  1:   NEMA  Class  1  efficiency  levels  for  liquid-filled  distribution  transformers.    (Adapted  from  NEMA  Standards 
Publication  TP  1,  Table  4-1  [4].) 


Single  Phase 

Three  Phase 

kVA 

Efficiency 

kVA 

Efficiency 

10 

98.3 

15 

98.0 

15 

98.5 

30 

98.3 

25 

98.7 

45 

98.5 

37.5 

98.8 

75 

98.7 

50 

98.9 

112.5 

98.8 

75 

99.0 

150 

98.9 

100 

99.0 

225 

99.0 

167 

99.1 

300 

99.0 

250 

99.2 

500 

99.1 

333 

99.2 

750 

99.2 

500 

99.3 

1000 

99.2 

667 

99.4 

1500 

99.3 

833 

99.4 

2000 

99.4 

2500 

99.4 

Table  2:    NEMA  Class  1  efficiency  levels  for  dry-type  distribution  transformers.     (Adapted  from  NEMA  Standcirds 
Publication  TP  1,  Table  4-2  [4].) 


Single 

Phase 

Three  Phase 

Efficiency 

Efficiency 

kVA 

Low  Voltage 

Medium  Voltage 

kVA 

Low  Voltage 

Medium  Voltage 

15 

97.7 

97.6 

15 

97.0 

96.8 

25 

98.0 

97.9 

30 

97.3 

97.3 

37.5 

98.2 

98.1 

45 

97.7 

97.6 

50 

98.3 

98.2 

75 

98.0 

97.9 

75 

98.5 

98.4 

112.5 

98.2 

98.1 

100 

98.6 

98.5 

150 

98.3 

98.2 

167 

98.7 

98.7 

225 

98.5 

98.4 

250 

98.8 

98.8 

300 

98.6 

98.5 

333 

98.9 

98.9 

500 

98.7 

98.7 

500 

— 

99.0 

750 

98.8 

98.8 

667 

— 

99.0 

1000 

98.9 

98.9 

833 

99.1 

1500 
2000 
2500 

— 

99.0 

99.0 
99.1 
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acceptable  product  could  pass  by  chance  under  that 
sampling  plan.  The  second  figure-of-merit,  the  testing 
burden,  is  the  average  number  of  units  tested  under 
that  sampling  plan.  The  testing  burden  may  be  con- 
sidered in  estimating  the  average  cost  of  testing  and  in 
recommending  minimum  or  maximum  sample  sizes. 

These  testing  protocols  are  examined  by  means  of 
model  calculations.  Two  approaches  are  taken  in  this 
analysis:  Firstly,  where  analytic  expressions  or  numer- 
ical approximations  for  the  desired  figures-of-merit  are 
derived,  these  expressions  are  evaluated  numerically. 
A  discussion  of  these  algorithms  is  presented  in  ap- 
pendix D  and  in  [8,  9,  10].  Secondly,  Monte  Carlo  [11] 
simulations  are  used  to  estimate  these  figures-of-merit. 
These  approaches  differ  substantially,  and  each  should 
be  considered  an  independent  estimate  of  the  figure- 
of-merit.  Comparison  of  the  results  obtained  by  nu- 
merical computation  and  Monte  Carlo  simulation  may 
thus  lend  support  to  the  calculated  value.  Monte  Carlo 
methods  have  an  added  advantage  for  this  analysis,  in 
that  they  may  be  adapted  to  evaluate  sampling  plans 
where  the  sample  size  is  not  fixed,  and  may  thus  pro- 
vide estimates  of  the  operating  characteristic  and  the 
testing  burden  for  such  plans. 

The  nature  of  testing  under  the  sampling  plans  given  in 
10  CFR  Part  430,  the  proposed  new  10  CFR  Part  432, 
and  NEMA  Standard  TP  2  introduces  a  computational 
problem,  in  that  the  number  of  units  tested  may  not 
be  fixed  from  the  outset  of  testing:  For  most  products 
tested  under  the  10  CFR  Part  430  sampling  plan,  a 
manufacturer  could  test  as  few  as  two  units,  but  may 
test  any  larger  number.  One  exception  to  this  minimum 
sample  size  of  two  is  lamp  ballasts  for  which  not  fewer 
than  four  units  must  be  tested.  Under  the  proposed 
new  10  CFR  Part  432  for  distribution  transformers,  a 
manufacturer  could  test  as  few  as  five  units  of  each  ba- 
sic model,  but  may  test  any  larger  number  of  units, 
including  all  units.  Under  the  TP  2  sampling  plan  a 
manufacturer  may  test  all  units  manufactured  during 
a  period  of  180  days,  or  may  conduct  monthly  tests 
over  a  period  of  180  days  of  no  fewer  than  five  units. 
The  scenario  in  which  the  sample  size  is  not  fixed  is 
difficult  to  characterize  by  analytical  methods,  and  we 
have  chosen  to  first  treat  these  sampling  plans  in  the 
approximation  that  the  sample  size  is  fixed  from  the 
outset.  Results  obtained  under  this  approximation  pro- 
vide a  lower  bound  on  the  probability  of  being  found 
in  compliance.  For  example,  while  testing  under  the 
10  CFR  Part  430  sampling  plan,  a  fixed  sample  of  five 
units  would  include  some  caises  for  which  a  manufac- 
turer was  found  in  compliance  after  testing  two  units 
and  could  have  stopped  testing  at  that  point,  but  fails 
after  testing  five  units  due  to  the  final  three  test  results. 
The  computed  probabilities  for  a  fixed  sample  size  may 
thus  under-estimate  the  probability  of  being  found  in 


compliance. 

Detailed  information  regarding  the  distribution  of  ef- 
ficiencies is  required  for  these  calculations;  and  we  as- 
sume that  the  population  of  efficiency  is  normally  dis- 
tributed with  mean,  n,  and  standard  deviation,  a.  We 
further  assume  that  the  units  tested  are  selected  at  ran- 
dom. 


4.1     Loss  representation 

We  have  chosen,  for  this  analysis,  to  represent  trans- 
former energy  performance  in  terms  of  energy  use,  i.e. 
losses.  This  representation  is  chosen  because  it  provides 
a  direct  comparison  with  industry  standards.  Further, 
the  loss  representation  has  the  advantage  of  being  in- 
dependent of  efficiency:  The  tolerance  on  the  measured 
loss  specified  in  the  NEMA  and  IEEE  standards  is  given 
as  a  percentage  of  the  rated  loss  and  is  independent  of 
efficiency.  Thus  the  operating  characteristic  and  testing 
burden  are  independent  of  efficiency  in  the  loss  repre- 
sentation. 

In  the  discussion  that  follows,  the  operating  charac- 
teristic and  testing  burden  of  each  sampling  plan  are 
represented  by  contour  plots  in  coordinates  of  the  aver- 
age loss  and  the  standard  deviation  of  loss,  where  both 
are  given  as  a  percentage  of  the  rated  loss.  In  all  cases, 
the  rated  loss  corresponds  to  100  percent  on  the  loss 
axis. 

Expressed  as  a  percentage,  transformer  efficiency,  E,  is 
given  by  the  following  equation: 


E  = 


P  +  L 


X  100, 


where  P  is  the  output  power  and  L  is  the  loss  power. 
In  practice,  the  no-load  loss  is  measured  at  the  rated 
voltage  and  the  load  loss  at  the  rated  current  and  a 
determination  of  efficiency  involves  three  critical  mea- 
surements: power,  voltage,  and  current.  Of  these,  the 
measurement  of  loss  power  is  the  most  difficult  resulting 
in  measurement  uncertainties  that  are  about  an  order 
of  magnitude  greater  than  those  of  voltage  and  current 
measurement. 

In  summary,  the  measurement  uncertainty  of  the  effi- 
ciency depends  primarily  on  the  uncertainty  of  the  loss 
measurement.  This  discussion  is  provided  by  way  of 
explanation  for  the  specification  of  a  tolerance  on  the 
measured  loss  in  the  IEEE  and  NEMA  standards.  Since 
the  critical  measurement  contributing  to  the  measure- 
ment uncertainty  in  the  efficiency  is  the  uncertainty  in 
the  loss  measurement,  as  a  practical  matter  it  is  most 
effective  to  specify  a  tolerance  for  the  measurement  of 
loss. 


A  Case  Study  with  Application  to  Distribution  Transformers 


NISTTN  1427 


5     Compliance  testing 

Three  sampling  plans  are  discussed:  the  sampling  plan 
put  forward  by  10  CFR  Part  430  [1],  the  sampling  plan 
proposed  for  the  new  10  CFR  Part  432  [3],  and  the 
sampling  plan  established  by  NEMA  Standard  TP  2  [5]. 


5.1      10  CFR  Part  430  and  the  proposed 
10  CFR  Part  432  (Method  I) 

In  the  discussion  that  follows,  we  refer  to  the  sampling 
plans  provided  in  10  CFR  Part  430  and  proposed  for 
the  new  10  CFR  Part  432  as  Method  I  type  plans. 

5.1.1      10  CFR  Part  430 

10  CFR  Part  430  establishes  specific  criteria  for  each 
covered  product  when  testing  for  comphance  with  a 
rated  energy  performance.  An  example  of  these  cri- 
teria, which  applies  to  dishwashers,  is  provided  in  ap- 
pendix A  of  this  report.  The  general  structure  of  this 
sampling  plan  is  followed  for  all  other  products  cov- 
ered under  10  CFR  Part  430.  To  emphasize  its  salient 
features,  we  paraphrase  the  Part  430  samphng  plan  as 
follows: 

(i)  Compliance  with  a  rated  energy  consumption  is 
demonstrated  provided; 

(A)  The  average  energy  consumption  of  the 
sample  is  not  greater  than  the  rated  en- 
ergy consumption,  and 

(B)  The  upper  9772  percent  confidence  limit 
of  the  average  energy  consumption  of  the 
entire  population  divided  by  1.05  is  not 
greater  than  the  rated  energy  consump- 
tion. 

(ii)  Compliance  with  a  rated  efficiency  is  demonstrated 
provided; 

(A)  The  average  efficiency  of  the  sample  is  not 
less  than  the  rated  efficiency,  and 

(B)  The  lower  97^2  percent  confidence  limit 
of  the  average  efficiency  of  the  entire  pop- 
ulation divided  by  0.95  is  not  less  than  the 
rated  efficiency. 

For  a  given  population,  the  operating  characteristic  and 
testing  burden  of  these  criteria  depend  on  three  factors: 
1)  the  sample  size,  2)  the  statistical  confidence  in  (i)(B) 
and  (ii)(B)  and  3)  the  value  of  the  divisor  specified  in 
(i)(B)  and  (ii)(B).  The  statistical  confidence  and  the 
divisors  are  underlined  in  the  above  text.    Under  10 


CFR  Part  430,  the  statistical  confidence  specified  in 
(i)(B)  and  (ii)(B)  ranges  in  value  between  90  percent 
and  99  percent.  While  the  divisor  ranges  in  value  be- 
tween 1.01  and  1.10  in  (i)(B)  and  between  0.90  and  0.99 
in  (ii)(B). 

Under  this  sampling  plan  a  manufacturer  is  required 
to  test  only  as  needed  to  demonstrate  the  specified  sta- 
tistical confidence.  The  rule  language  in  10  CFR  Part 
430  states  that  the  sample  should  be  of  "sufficient  size" 
to  ensure  a  statistical  confidence  that  is  not  less  than 
97^2  percent,  in  the  example  cited.  Assuming  that 
the  statistical  confidence  is  established  from  test  data 
alone,  the  minimum  sample  size  under  this  plan  is  two. 
The  reason  for  this  minimum  value  is  that  the  sample 
standard  deviation  is  not  defined  for  a  sample  of  one. 


5.1.2     The  proposed  10  CFR  Part  432 

A  Method  I  type  plan  is  also  proposed  for  distribution 
transformers  in  10  CFR  Part  432  [3].  The  proposed 
sampling  plan  is  provided  in  appendix  A  of  this  report. 
We  paraphrase  this  sampling  plan  as  follows: 

A  sample  of  not  fewer  than  five  units  must  be 
tested.  Compliance  with  a  rated  energy  efficiency 
is  demonstrated  provided: 

(a)  The  mean  efficiency  of  the  sample  is  not 
less  than  the  rated  efficiency,  and 

(b)  The  lower  95  percent  confidence  limit  of 
the  average  efficiency  of  the  entire  popu- 
lation divided  by  [1  -  0.03(1  -  Es/lOO)], 
where  Eg  is  the  rated  efficiency,  is  not  less 
than  the  rated  efficiency. 

Criteria  for  the  demonstration  of  compliance  with  a 
rated  loss  are  not  proposed  in  10  CFR  Part  432.  How- 
ever, the  criteria  proposed  for  compliance  testing  may 
be  stated  in  terms  of  loss;  and  such  loss  criteria  are  fully 
equivalent  to  the  sampling  plan  for  compliance  testing 
proposed  10  CFR  Part  432.  These  criteria  are  included 
here  for  illustrative  purposes  and  for  consideration  of 
users  who  may  wish  to  analyze  intermediate  test  data 
in  terms  of  loss  power.  When  stated  in  terms  of  loss, 
the  proposed  sampling  plan  may  be  paraphrased  as  fol- 
lows: 

A  sample  of  not  fewer  than  five  units  must  be 
tested.  Compliance  with  a  rated  loss  is  demon- 
strated provided: 

(a)  The  average  loss  power  of  the  sample  is 
not  greater  than  the  rated  loss  power,  and 
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(b)  The  upper  95  percent  confidence  limit  of 
the  loss  power  of  the  entire  population  di- 
vided by  1.03  is  not  greater  than  the  rated 
loss  power. 

It  should  be  emphasized  that  the  divisor  in  criterion 
(b)  above  establishes  a  tolerance  on  the  estimate  of 
the  mean  loss  of  the  population.  This  tolerance  on 
the  estimate  of  the  mean  loss  should  not  be  confused 
with  the  considerably  larger  loss  tolerance  established 
by  ANSI  Standards  57.12.00-1993  and  57.12.01  and 
NEMA  Standard  TP2:  The  loss  tolerance  established 
by  these  standards  applies  to  the  measured  loss  of  a 
single  unit. 

It  may  be  noted  that  the  divisors  in  criterion  (b)  differ 
when  the  criteria  for  compliance  testing  are  stated  in 
terms  of  efficiency  or  loss.  This  feature  differs  from  the 
lOCFR  Part  430  sampling  plans.  In  the  example  pro- 
vided from  10  CFR  Part  430,  the  divisors  applied  in  the 
ca^es  of  efficiency  testing  and  energy  consumption  test- 
ing are  1-1-0.05  and  1—0.05,  respectively.  In  effect,  these 
divisors  establish  a  tolerance  of  5  percent  for  both  the 
estimate  of  the  mean  efficiency  and  the  estimate  of  the 
mean  energy  consumption.  The  use  of  an  equivalent 
tolerance  on  the  estimate  of  the  mean  efficiency  and 
mean  loss  may  not  apply  for  devices  that  are  highly  ef- 
ficient such  as  distribution  transformers.  The  relation- 
ship between  the  uncertainty  in  the  measurement  of 
efficiency  and  of  loss  is  given  by  m  ==  —  n(l  —  Eg/ 100), 
where  m  is  the  measurement  uncertainty  in  the  effi- 
ciency, n  is  the  measurement  uncertainty  in  the  loss, 
and  Eg  is  the  rated  value  of  efficiency  for  the  product. 
Clearly,  in  the  limit  that  Eg  approaches  100  percent 
the  measurement  uncertainty  in  the  efficiency  is  much 
less  than  in  the  loss. 


5.1.3     Results 

The  results  of  model  calculations  for  the  Method  I  sam- 
pling plan  are  shown  in  Figs.  1-9,  where  data  are  pre- 
sented for  a  statistical  confidence  of  95  percent  and  for 
values  of  loss  tolerance  of  103  percent,  106  percent,  and 
112  percent.  Sampling  plans  using  both  fixed  samples 
and  variable  sizes  are  treated.  The  results  shown  in 
Figs.  2  to  5  are  of  particular  interest  to  the  transformer 
CcLse. 

For  samples  of  fixed  size,  a  rated  efficiency  is  demon- 
strated provided: 

1.  the  sample  average  loss  is  less  than  100  percent, 
and 

2.  the  upper  95  percent  confidence  limit  of  the  mean 
loss  is  not  greater  than  the  loss  tolerance. 


The  condition  on  the  loss  tolerance  LT  is  equivalent  to 
the  use  of  a  divisor  in  (i)(B).  A  sampling  plan  based  on 
a  loss  tolerance  of  103  percent,  for  example,  exhibits 
the  same  behavior  as  the  use  of  a  1.03  divisor. 

Samples  of  fixed  size  are  first  examined.  The  operat- 
ing characteristic  of  the  Method  I  sampling  plan  for  a 
loss  tolerance  of  103  percent  for  samples  of  2,  5,  10,  20, 
and  30  units  are  shown  in  Figs.  1-5,  respectively.  The 
dependence  of  the  operating  characteristic  on  the  loss 
tolerance  is  shown  in  Figs.  6-9,  which  are  for  the  sam- 
ples of  two  and  five  and  for  loss  tolerances  of  106  per- 
cent and  112  percent.  Monte  Carlo  simulations  were 
also  performed  for  each  of  these  cases  and  results  ob- 
tained by  these  methods  are  shown  in  half-tone  in  each 
of  these  figures.  Aside  from  the  random  fluctuations, 
which  are  inherent  to  Monte  Carlo  methods,  the  two 
methods  appear  to  give  equivalent  results. 

Examination  of  these  data  suggests  the  following  inter- 
pretation of  the  Method  I  sampling  plan:  For  samples 
of  fixed  size,  the  Method  I  sampling  plan  provides  as- 
surance at  the  specified  statistical  confidence  that  the 
average  loss  does  not  exceed  the  loss  tolerance.  In  this 
case,  the  statistical  confidence  is  95  percent  and  thus 
the  risk  of  exceeding  the  loss  tolerance  is  not  greater 
than  5  percent.  This  behavior  is  indicated  by  the 
asymptotic  limit  of  the  0.05  contours,  which  in  each 
figure  approach  the  loss  tolerance  at  large  standard  de- 
viation. 

Two  additional  analyses,  which  may  be  modeled  by 
Monte  Carlo  simulations,  are  suggested  by  these  re- 
sults: 1)  the  operating  characteristic  and  2)  the  test- 
ing burden  under  this  sampling  plan  when  the  sample 
size  is  not  fixed.  In  principle,  the  Monte  Carlo  simu- 
lation should  provide  a  more  realistic  estimate  of  the 
Method  I  operating  characteristic  and  testing  burden. 
The  conditions  for  a  determination  of  compliance  for 
variable  sample  size  are  identical  to  those  used  for  a 
fixed  sample;  however,  in  this  case,  testing  is  contin- 
ued up  to  a  maximum  sample  of  twenty  or  until  the 
following  condition  is  satisfied: 


n  > 


tS 


LT  -  100 


where  n  is  the  sample  size,  LT  is  the  loss  tolerance,  S  is 
the  sample  standard  error,  and  t  is  the  fifth  percentile 
of  the  t-distribution  for  n  —  1  degrees  of  freedom. 

The  results  of  these  simulations  are  presented  in 
Figs.  10  and  11,  which  respectively  depict  the  oper- 
ating characteristic  and  the  testing  burden  at  a  loss 
tolerance  of  103  percent.  These  operating  character- 
istics suggest  that  the  assurance  on  loss  performance 
may  be  somewhat  less  than  for  fixed  samples,  as  the 
asymptotic  limit  of  the  0.05  contour  appears  to  be  on 
the  order  of  106  percent.    These  data  further  suggest 
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that  the  marginal  loss  performance  required  to  provide 
a  high  probability  of  demonstrating  compliance  may  be 
appreciable  under  this  sampling  plan,  where  marginal 
loss  performance  refers  to  the  difference  between  the 
rated  loss  and  the  true  average  loss.  It  should  be  em- 
phasized, however,  that  the  operating  characteristics 
shown  in  the  figure  are  those  for  minimal  testing  and 
that,  under  the  Method  I  sampling  plan,  a  manufac- 
turer may  be  able  to  reduce  the  marginal  loss  by  in- 
creasing the  sample  size. 


5.2     NEMA  Standard  TP  2  (Method  II 
and  Method  III) 

The  NEMA  TP  2  sampling  plan  for  demonstrating  the 
efficiencies  established  by  NEMA  Standard  TP  1  is  next 
presented.  The  NEMA  TP  2  samphng  plan  is  given  in 
sections  7.0  and  7.1  of  the  standard,  which  can  be  found 
in  appendix  B  of  this  report. 

NEMA  Standard  TP  2  provides  that  the  aggregate 
measured  input  power  of  all  transformers  tested  for  a 
period  of  180  days  be  no  greater  than  that  allowed  by 
the  rated  efficiency.  The  proposed  10  CFR  Part  432 
contemplates  measurement  of  the  average  efficiency  of  a 
basic  model,  where  a  basic  model  may  be  distinguished 
by  the  significant  characteristics  of  that  product  such 
as  the  kVA  rating,  voltage  rating,  and  insulation  type, 
for  example.  The  question  of  whether  it  is  appropri- 
ate to  aggregate  a  broad  range  of  product  types  for 
the  purposes  of  determining  an  average  energy  perfor- 
mance, as  is  allowed  under  NEMA  Standard  TP  2,  is 
not  addressed  here.  For  purposes  of  this  discussion,  we 
assume  that  the  TP  2  sampling  plan  is  applied  to  mea- 
sure the  average  efficiency  or  the  average  energy  use  of 
a  baisic  model.  When  applied  to  a  basic  model,  this 
condition  on  the  measured  input  power  is  equivalent 
to  an  average  measured  efficiency  that  is  not  less  than 
the  rated  efficiency  and  an  average  measured  loss  that 
is  not  greater  than  the  rated  loss.  The  TP  2  sampling 
plan  thus  establishes  a  condition  on  the  mean  efficiency 
or  mean  loss  of  a  sample. 

The  TP  2  sampling  plan  provides  further  that  no  unit 
may  exceed  108  percent  of  the  rated  loss.  This  toler- 
ance on  the  measured  loss  may  be  interpreted  in  two 
ways:  1)  The  tolerance  on  the  measured  loss  may  estab- 
lish a  quality  control  limit  for  the  NEMA  Class  I  rating, 
but  this  tolerance  ha^  no  bearing  on  any  demonstration 
of  compliance  with  a  rated  efficiency.  This  interpreta- 
tion of  the  TP  2  sampling  plan  places  a  condition  on 
the  mean  of  the  sample.  This  scenario  will  be  referred 
to  here  as  a  Method  II  type  sampling  plan.  2)  Another 
interpretation  of  the  TP  2  sampling  plan  places  a  con- 
dition on  the  mean  of  the  sample  and  on  the  sample  ex- 
tremum,  where  the  sample  extremum  is  the  maximum 


measured  loss  of  any  unit  in  the  sample.  This  scenario 
will  be  referred  to  here  as  a  Method  III  type  sampling 
plan.  Method  III  type  criteria  are  used  for  quahty  as- 
surance of  various  packaged  goods  [12,  13]  and  have 
been  proposed  for  use  in  testing  whether  electric  mo- 
tors comply  with  a  rated  efficiency  [9].  An  approximate 
solution  for  the  probability  that  such  conditions  on  the 
sample  mean  and  on  the  sample  extremum  are  satisfied 
is  discussed  by  Vangel  [8]. 

Two  scenarios  for  sampling  are  presented  in  TP  2: 
all  units  manufactured  during  a  180  day  period  may 
be  tested,  or  units  may  be  tested  on  a  monthly  basis 
for  a  period  of  180  days.  The  standard  provides  that 
no  fewer  than  five  units  may  be  tested  during  these 
monthly  tests  and  that  the  sample  size  shall  be  suffi- 
cient to  ensure  a  statistical  confidence  of  not  less  that 
95  percent.  The  statistical  confidence  is  established  by 
the  condition 

n  =  {tSKf, 

where  n  is  the  sample  size,  S  is  the  sample  standard 
deviation,  the  value  of  t  is  selected  according  to  the 
number  of  units  tested  as  tabulated  in  TP  2,  and  the 
coefficient  K  is  given  by  the  equation 


K 


108  -  O.OSS^L 

5EL(8  -  0.085EL) ' 


where  SEL  is  the  standard  efficiency  level  in  percent. 
This  condition  on  the  sample  size  is  equivalent  to  that 
used  under  the  Method  I  sampling  plan  and  is  that 
recommended  by  ASTM  Standard  E  122-89  [14]. 


5.2.1      Method  II  results 

The  operating  characteristics  and  testing  burden  of 
Method  II  are  presented  in  Figs.  12-17. 

Under  Method  II,  one  condition  must  be  satisfied  to 
demonstrate  compliance  with  a  rated  performance: 

1.  the  mean  loss  of  the  sample  must  be  no  greater 
than  100  percent. 

The  operating  characteristics  for  samples  of  fixed  size 
are  shown  in  Figs.  12-15,  which  depict  samples  of  5, 
10,  20,  and  30  units.  Monte  Carlo  simulations  were 
again  performed  for  each  of  these  cases  and  the  results 
of  these  simulations  are  shown  in  each  of  these  figures 
in  half-tone.  Numerical  computation  and  Monte  Carlo 
simulation  appear  to  yield  consistent  values. 

The  case  of  variable  sample  size  is  examined  in  Figs.  16 
and  17,  which  depict  the  operating  characteristics  and 
the  testing  burden  of  Method  II,  respectively.  These 
data  apply  to  the  case  of  monthly  testing  under  TP  2 
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where  the  the  minimum  units  tested  is  thirty.  The  con- 
ditions for  a  demonstration  of  compUance  for  a  variable 
sample  axe  identical  to  those  for  fixed  sample  size;  how- 
ever, in  this  case  testing  is  continued  until  the  condition 


n> 


tS 


LT  -  100 


is  satisfied. 


5.2.2     Method  III  results 

The  operating  characteristics  and  testing  burden  of 
Method  III  are  presented  in  Figs.  18-23. 

Under  Method  III,  two  conditions  must  be  satisfied  to 
demonstrate  compliance  with  a  rated  performance: 

1.  the  mean  loss  of  the  sample  must  be  no  greater 
than  100  percent,  and 

2.  no  single  unit  in  the  sample  may  exceed  108  per- 
cent of  the  rated  loss. 

It  should  emphasized  that  under  Method  III  the  en- 
tire population  is  not  in  compliance  if  any  unit  in  the 
sample  exceeds  108  percent  of  the  rated  loss.  The  oper- 
ating characteristics  for  samples  of  fixed  size  are  shown 
in  Figs.  18-21,  which  depict  samples  of  5,  10,  20,  and  30 
units.  Monte  Carlo  simulations  were  again  performed 
for  each  of  these  cases  and  the  results  of  these  simula- 
tions are  shown  in  each  of  these  figures  in  half-tone. 
Numerical  computation  and  Monte  Carlo  simulation 
appear  to  yield  consistent  values. 

The  case  of  variable  sample  size  is  examined  in  Figs.  22 
and  23,  which  depict  the  operating  characteristics  and 
the  testing  burden  of  Method  III,  respectively.  These 
data  apply  to  the  case  of  monthly  testing  under  TP  2 
where  the  the  minimum  units  tested  is  thirty.  The  con- 
ditions for  a  demonstration  of  compliance  for  a  variable 
sample  are  identical  to  those  for  fixed  sample  size;  how- 
ever, in  this  case  testing  is  continued  until  the  condition 


n  > 


tS 


LT  -  100 


is  satisfied  or  the  sample  exceeds  twenty,  whichever  oc- 
curs first.  It  should  be  noted  that  a  maximum  sample 
size  is  not  stipulated  in  the  TP  2  sampling  plan:  the 
maximum  sample  size  of  twenty  used  here  was  included 
to  simplify  the  Monte  Carlo  simulation. 


5.3     Discussion 

For  a  fixed  sample  size,  the  operating  characteristics  of 
Method  I,  Method  II,  and  Method  III  are  very  similar 


at  small  standard  deviation.  This  is  due  to  the  condi- 
tion placed  on  the  sample  mean  loss  under  these  sam- 
pling plans:  Each  of  these  sampling  plans  require  that 
the  sample  mean  loss  be  no  greater  than  the  rated  loss; 
thus  at  small  standard  deviation,  where  the  determi- 
nation of  compliance  is  based  primarily  on  the  sample 
mean  loss,  each  of  these  sampling  plans  exhibit  similar 
operating  characteristics. 

It  should  be  noted  that  the  operating  characteristic 
of  these  sampling  plans  depends  on  the  sample  size. 
However,  these  sampling  plans  exhibit  very  different 
behavior  with  increased  sample  size.  For  example,  the 
marginal  loss  required  under  Method  I  to  provide  a  high 
probability  of  demonstrating  compliance  decreases  with 
sample  size.  Thus  the  marginal  loss  may  be  reduced  to 
an  acceptable  level  under  the  Method  I  sampling  plan 
by  additional  testing.  The  behavior  of  the  Method  III 
sampling  plan  is  much  different.  Under  Method  III,  the 
risk  of  failing  to  demonstrate  compliance  may  actually 
increase  with  increased  sample  size.  The  reason  for  this 
behavior  is  that  as  the  sample  size  increases  the  likeli- 
hood of  sampling  from  the  wing  of  the  distribution  of 
loss  increases. 

The  design  performance  of  a  transformer  may  depend 
on  both  engineering  and  business  factors.  However,  it 
appears  from  this  analysis  that  each  of  these  sampling 
plans  favor  loss  performance  below  the  rated  value. 
Since,  if  a  transformer  were  designed  to  perform,  and 
indeed  performed  at  the  rated  loss  on  average,  the  likeli- 
hood of  demonstrating  compliance  with  that  rated  per- 
formance is  not  greater  than  50  percent  under  each  of 
these  plans. 

The  Method  I,  Method  II,  and  Method  III  sampling 
plans  all  provide  assurance  that  the  mean  performance 
of  a  population  meets  or  exceeds  a  rated  value.  The 
Method  I  sampling  plan  appears  to  be  perform  well 
in  cases  where  large  quantities  are  available  for  testing 
and  the  cost  of  testing  is  low.  However,  one  unique 
character  of  distribution  transformers  is  that  the  lot 
size  can  be  small.  Indeed  some  transformers  are  man- 
ufactured in  extremely  limited  numbers.  In  that  the 
marginal  loss  can  be  appreciable  for  small  samples,  the 
Method  I  sampling  plan  may,  in  effect,  require  that 
certain  transformers  have  average  losses  that  are  ap- 
preciably less  than  their  rated  loss.  Alternately  the 
Method  III  sampling  plan  may  place  a  high  burden  on 
manufacturers  when  it  is  applied  to  large  samples. 


6     Enforcement  testing 

The  Sampling  Plan  for  Enforcement  Testing  provided 
in  10  CFR  Part  430  applies  to  all  products  covered  un- 
der Part  430.  A  similar  plan  has  been  proposed  in  the 
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new  10  CFR  Part  431  for  electric  motors.  The  proposed 
10  CFR  Part  432  [3]  does  not  include  a  Sampling  Plan 
for  Enforcement  Testing.  Its  development  will  be  con- 
sidered at  a  later  date.  While  some  details  may  change, 
the  general  format  of  the  plan  is  expected  to  remain  the 
same  if  and  when  it  is  finalize  for  transformers. 

The  Sampling  Plan  for  Enforcement  Testing  provided 
in  10  CFR  Part  430  establishes  clearly  delineated  pro- 
cedures to  be  followed  under  an  enforcement  action. 
This  sampling  plan  is  based  on  a  well  established  sta- 
tistical method,  which  is  due  to  C.  Stein  [15],  for  ob- 
taining a  confidence  interval  on  a  mean.  A  discussion 
of  this  procedure  can  also  be  found  in  Bickel  and  Dok- 
sum  [16].  The  Sampling  Plan  for  Enforcement  Testing 
provided  in  10  CFR  Part  430  covers  both  testing  of 
efficiency  and  for  energy  consumption  and  it  is  very 
general.  The  sampling  plan  presented  in  appendix  C 
has  been  adapted  from  10  CFR  Part  430;  however,  it 
has  been  simplified  somewhat  to  clarify  the  procedure 
and  it  includes  only  the  case  for  efficiency  testing. 

The  sampling  plan  is  based  on  a  t-test.  The  i-test  is 
well  suited  to  this  application  as  it  is  known  to  be  insen- 
sitive to  departures  from  the  assumption  of  normality: 
The  t-test  is  a  test  on  a  mean,  which  is  an  average 
of  independent  values  obtained  by  a  random  sample. 
Since,  sums  of  arbitrary,  independent  random  values 
tend  to  have  a  distribution  that  is  almost  normal,  the 
t-test  is  not  strongly  influenced  by  the  exact  form  of 
the  underlying  distribution  of  efficiencies. 

Since  the  test  results  obtained  during  enforcement  test- 
ing may  recommend  that  certain  adverse  actions  be 
taken  against  a  manufacturer:  relabeling  of  specific 
products,  the  cessation  of  distribution  and  sale  of  cer- 
tain basic  models,  and/or  the  assessment  of  fines,  for 
example;  the  risk  to  a  manufacturer  of  a  false  deter- 
mination of  noncompliance  during  an  enforcement  ac- 
tion is  set,  by  design,  to  a  negligible  level.  The  Sam- 
pling Plan  for  Enforcement  Testing  provided  in  10  CFR 
Part  430  is  based  on  a  97.5  percent  statistical  confi- 
dence, thus  the  risk  to  a  manufacturer  of  a  chance  false 
determination  of  noncompliance  is  not  greater  than 
2.5  percent. 


6.1      10  CFR  Part  430 

An  estimate  of  the  true  mean  efficiency  is  first  obtained 
by  a  random  sample. 


1     " 


(1) 


i=l 


here  Xi  is  the  measured  efficiency  of  unit  i,  and  n  is 
the  number  of  units  tested.  The  uncertainty  in  this 
estimate  depends  on  two  factors:    1)  the  size  of  the 


sample,  i.e.  the  number  of  transformers  tested,  and  2) 
the  underlying  variability  in  the  entire  population.  The 
sample  standard  deviation, 


5  = 


n-l 


(2) 


provides  an  estimate  of  the  population  standard  devi- 
ation a;  and  the  standard  error  in  the  mean, 


SE{X) 


y/n' 


(3) 


provides  an  estimate  of  the  standard  deviation  of  the 
mean  for  samples  of  n  units.  For  a  normal  distribution 
with  mean  fi;  the  ratio, 


t  = 


fj.  —  X 
SE{X)' 


(4) 


is  distributed  according  to  a  probability  density  func- 
tion that  is  know  in  statistics  literature  as  the  t- 
distribution.  Now  eq.  4  may  be  rearranged  to  provide 
an  expression  for  the  mean  of  the  sample: 


X  =  ^i-tSE{X), 


(5) 


where  the  value  of  t  is  cissociated  with  a  specific  sample 
size  and  statistical  confidence.  Values  of  t  are  readily 
available  and  are  included  in  many  references  on  statis- 
tics [17]. 

In  a  test  of  compliance  with  a  rated  efficiency,  RE, 
we  assume,  by  hypothesis,  that  the  units  to  be  tested 
are  drawn  from  a  population  of  transformers  for  which 
the  mean  efficiency  is  equal  to  or  greater  than  the  rated 
efficiency.  If  t  is  the  97.5  percentile  of  the  f-distribution 
for  n  —  1  degrees  of  freedom,  then  the  probability  of 
obtaining  a  mean  efficiency, 


X  <RE  +  tSE{X), 


(6) 


is  not  less  than  97.5  percent.    This  procedure  recom- 
mends the  upper  control  limit, 


UCL  =  RE  +  tSE{X] 


(7) 


To  apply  this  method,  a  random  sample  is  tested  and 
the  mean  and  standard  error  in  the  mean  are  cal- 
culated. Based  on  the  size  of  the  sample  and  the 
confidence  desired,  the  appropriate  f-value  is  selected 
and  the  lower  control  limit  calculated.  For  example, 
97.5  percent  confidence  and  a  sample  size  of  five  units 
yields  a  <-value  of  3.18.  Provided  the  meaji  efficiency 
obtained  from  the  random  sample  is  not  less  than  the 
lower  control  limit,  as  defined  by  eq.  7,  we  may  assert 
with  a  confidence  not  less  than  97.5  percent  that  the 
true  mean  energy  consumption  of  the  entire  population 
is  not  greater  than  the  rated  efficiency. 
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In  any  statisticeil  test  there  is  some  probability  of  in- 
correctly concluding  noncompliaxice.  By  design,  the 
probability  that  the  mean  efficiency  for  a  random  sam- 
ple drawn  from  this  population  of  transformers  would 
fall  below  the  lower  control  limit,  hence,  the  risk  of 
incorrectly  concluding  that  the  baisic  model  is  in  non- 
compliance, is  not  greater  than  2.5  percent. 

There  is  some  probability  that  the  sample  standard  de- 
viation may  be  large  and  that  the  lower  control  hmit 
may  be  set,  by  chance,  to  an  exceptionally  low  value. 
This  circumstance  may  be  avoided  by  placing  a  toler- 
ance on  the  standard  error  in  the  mean,  SE{X).  The 
tolerance  for  the  standard  error  should  be  chosen  to 
be  appropriate  for  that  product  and  to  be  supported 
across  the  industry. 

Choosing,  for  example,  a  loss  tolerance  of  108  percent. 


fJ'min       — 


out 


Pin  +  0.08{Pin  -  Pout) 


xlOO 


108  -  0.08/x 


X  100, 


(8) 


where  Pin  and  Pout  are  the  input  and  output  power. 
The  lower  control  limit  must  then  satisfy  two  condi- 
tions: 

UCL  =  RE-  tSE{X)  (9) 


and 


UCL> 


RE 


-  108  -  0.08RE 


X  100, 


(10) 


where,the  second  condition  is  obtained  from  eq.  (8)  by 
setting  the  efficiency  equal  to  the  RE. 


6.2     Results 

The  operating  characteristic  and  the  testing  burden  of 
the  Sampling  Plan  for  Enforcement  Testing  are  shown 
in  Figs.  24-29.  Factors  that  influence  the  operating 
characteristic  and  testing  burden  include:  1)  the  size 
of  the  initial  sample,  2)  the  statistical  confidence,  and 
3)  the  tolerance  set  on  the  standard  error. 

It  may  be  noted  that  the  97.5  percent  contour  lies  along 
100  percent  loss  in  each  of  these  figures  and  that  the  risk 
of  a  false  outcome  is  therefore  independent  of  variability 
under  this  sampling  plan. 


7     Summary 


Compliance  testing:  The  operating  characteristic 
of  the  Method  I,  Method  II,  and  Method  III  sampling 
plans  are  equivalent  in  the  limit  of  small  standard  devi- 
ation. This  is  due  to  the  condition  placed  on  the  mean 


loss  of  the  sample  under  each  of  these  plans.  Since  un- 
der each  of  these  plans  the  mean  loss  of  the  sample  may 
not  exceed  the  rated  loss,  each  of  these  plans  provide 
assurance  that  the  mean  efficiency  of  a  population  is 
not  less  than  the  rated  efficiency.  When  testing  small 
samples  under  Method  I,  the  marginal  loss  performance 
may  be  appreciable  and  may,  in  effect,  require  that  cer- 
tain transformers  have  average  losses  significantly  less 
than  their  rated  values.  However,  under  Method  I,  a 
manufacturer  may  reduce  the  marginal  loss  by  testing 
additional  units.  Alternately  the  Method  III  sampling 
plan  appears  to  require  an  appreciable  marginal  loss 
performance  when  it  is  applied  to  large  samples  and 
may,  in  effect,  require  that  certain  transformers  have 
average  losses  significantly  less  than  their  rated  values. 

Enforcement  testing:  The  Sampling  Plan  for  En- 
forcement Testing  included  in  10  CFR  Part  430  is  based 
on  statistical  methods  that  are  widely  used  and  well 
documented.  The  sampling  plan  is  robust,  in  that  it 
is  a  test  on  the  mean  and  that  it  is  not  highly  depen- 
dent on  the  form  of  the  underlying  distribution.  The 
sampling  plan  is  designed  to  protect  the  interests  of 
the  manufacturer,  in  that  the  risk  of  a  false  outcome 
against  a  manufacturer  may  be  limited  to  some  accept- 
able level.  Additionally,  the  risk  of  a  false  outcome  is 
independent  of  variance. 

The  analysis  presented  here  is  of  value  primarily  as 
a  qualitative  evaluation  of  the  operating  characteris- 
tic and  the  testing  burden  of  these  testing  protocols 
and  secondarily  as  a  quantitative  estimate  of  the  sta- 
tistical confidence  associated  with  testing  under  these 
protocols.  While  the  agreement  noted  between  results 
obtained  by  analytical  methods  and  Monte  Carlo  sim- 
ulations is  encouraging,  it  should  be  noted,  since  these 
results  may  depend  on  our  model  assumptions,  that  a 
quantitative  estimation  of  statistical  confidence  is  more 
tenuous  than  qualitative  evaluation. 


8     Further  information 

For  information  on  the  rule  making  for  distribution 
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202-586-7425 

kathi.epping@ee.doe.gov 
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Appendix  A 

The  10  CFR  Part  430  and  the  proposed  10  CFR  Part  432  sampUng 

plans  for  compHance  testing 

The  following  test  criteria  are  presented  as  an  example  of  compliance  testing  under  10  CFR  Part  430.  Similar 
criteria  have  been  proposed  for  distribution  transformers  in  the  new  10  CFR  Part  432  [3]  and  are  also  presented. 

The  10  CFR  Part  430  criteria  presented  below  apply  specifically  to  dishwashers,  which  is  one  of  the  products 
covered  under  10  CFR  Part  430.  Similar  sampling  plans  are  provided  in  10  CFR  Part  430  §430.24  for  all 
other  covered  products.  The  statistical  confidence  and  divisor  used  in  criteria  (i)(B)  and  (III)(B)  differ  between 
products  and  are  specific  to  each  product.  The  values  of  these  coefficients  are  chosen  to  be  consistent  with 
current  industry  practice  for  that  product. 

§430.24  Units  to  be  tested. 

When  testing  of  a  covered  product  is  required  to  comply  with  section  323(c)  of  the  Act,  or  to  comply 
with  rules  prescribed  under  sections  324  or  325  of  the  Act,  a  sample  shall  be  selected  and  tested 
composed  of  units  which  are  production  units,  or  are  representative  of  production  units  of  the  beisic 
model  being  tested,  and  shall  meet  the  following  applicable  criteria. 

(c)(1)  For  each  beisic  model  of  dishwashers,  a  sample  of  sufficient  size  shall  be  tested  to  insure  that — 

(i)  Any  represented  value  of  estimated  annual  operating  cost,  energy  consumption  or  other  mea- 
sure of  energy  consumption  of  a  basic  model  for  which  consumers  would  favor  lower  values 
shall  be  no  less  that  the  higher  of  (A)  the  mean  of  the  sample  or  (B)  the  upper  9772  percent 
confidence  limit  of  the  true  mean  divided  by  1.05,  and 

(ii)  Any  represented  value  of  the  energy  factor  of  other  measure  of  energy  consumption  of  a  basic 
model  for  which  consumers  would  favor  higher  values  shall  be  no  greater  than  the  lower  of 
(A)  the  mean  of  the  sample  or  (B)  the  lower  9772  percent  confidence  limit  of  the  true  mean 
divided  by  0.95. 

The  criteria  given  below  are  proposed  for  distribution  transformers  in  the  new  10  CFR  Part  432.  The  values  of 
statistical  confidence  and  the  formulation  of  the  divisor  specified  in  (b)  are  chosen  to  be  consistent  with  current 
industry  practice. 

§432.24  Units  to  be  tested. 

For  each  basic  model  of  distribution  transformers,  a  random  sample  of  sufficient  size,  but  no  fewer 
than  five  productions  units,  shall  be  tested  to  insure  that  any  represented  value  of  efficiency  shall  be 
no  greater  than  the  lower  of  the: 

(a)  Mean  of  the  sample;  or 

(b)  The  lower  95%  confidence  limit  of  the  estimated  true  mean  divided  by  a  number  equal  to  [1  — 
0.03(1  —  £^5/100)],  where  Eg  is  the  represented  value  of  efficiency  claimed  for  that  particular  basic 
model. 
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Appendix  B 
The  NEMA  Standard  TP  2  sampling  plan 

Sections  7.0  and  7.1  of  NEMA  Standard  TP  2  follow.  The  reader  may  note  minor  differences  between  this 
appendix  and  the  NEMA  standard  TP  1,  e.g.,  the  pagination  and  the  reference  to  the  included  table  in  this 
appendix  differ  from  those  in  the  NEMA  standard  TP  1. 

SECTION  7 
Demonstration  of  Compliance 

7.0  General 

This  section  provides  a  methodology  for  proving  compliance  in  achieving  the  specified  efficiency  levels.  It  specifies 
monthly  sampling  over  a  180  day  period  for  the  cases  where  100%  of  the  units  are  not  tested.  This  standard 
requires  that  no  individual  transformer  shall  be  considered  acceptable  if  its  measured  losses  exceed  the  allowance 
by  more  than  8%. 

For  a  transformer  population  of  a  specific  kVA  rating,  compliance  with  the  energy  efficiency  standards  as  defined 
in  Section  4  of  NEMA  TP  1  shall  be  demonstrated  through  measurements  of  No-Load  and  Load  losses  according 
to  the  procedures  described  in  this  standard.  A  transformer  model  is  defined  as  all  transformers  of  the  same 
kVA  rating  and  type  as  described  in  the  efficiency  tables  of  NEMA  TP  1. 

According  to  the  IEEE  Standards  C57. 12.00  and  C57. 12.01  the  loss  tolerance  for  an  individual  unit  as  related 
to  guarantee  is  defined  as  follows: 

Limit  Beyond  Guarantee 

No  Load  Loss  10%  max. 

Total  Loss  at  100%  Load  6%  max. 

At  100%  load,  the  Load  Loss  is  normally  four  times  the  No  Load  loss,  suggesting  that  a  Load  Loss  variability 
of  approximately  5%  is  allowed.  The  sum  of  this  allowance  and  the  10%  variability  for  the  No  Load  loss  yields 
the  Total  Loss  variabifity  of  6%. 

Since  TP-1  tables  reflect  loss  measurements  at  35%  or  50%  of  rated  load  where  No  Load  Loss  is  equal  to  Load 
Losses,  the  6%  loss  tolerance  cannot  be  used  and  therefore  a  new  total  loss  tolerance  of  8%  shall  be  applicable 
at  these  measurement  points.  This  is  consistent  with  the  IEEE  Standards  C57. 12.00  and  C57.12.01. 

7.1  Number  of  Units  to  be  Tested 

NEMA  TP-1  requires  that  the  overall  efficiency  of  the  entire  population  of  transformers  must  meet  the  spec- 
ified efficiency  standards.  This  intent  is  satisfied  if  the  mean  efficiency  of  the  entire  population  satisfies  this 
requirement.  The  compliance  of  a  group  of  transformers  shall  be  demonstrated  by  testing  all  or  randomly  drawn 
samples  of  these  transformers. 

7.1.1  Compliance  Demonstration  Through  test  on  all  Transformers: 

Manufacturers  may  choose  to  test  all  units  of  various  kVA  ratings  manufactured  during  a  production  period  of 

180  days  to  demonstrate  compliance  with  the  efficiency  standard  NEMA  TP  1.  The  intent  of  this  standard  is 

satisfied  if  the  Total  Measure  kVA  Input  (TMI)  of  this  batch  of  transformers  is  equal  to  or  less  than  the  Total 

Allowed  kVA  Input  (TAI)  calculated  based  on  the  measured  and  specified  efficiency  levels  specified  in  TP  1. 

Each  individual  unit  from  this  production  batch  must  meet  or  exceed  the  minimum  acceptable  efficiency  level 

calculated  as  follows: 

SEL 
Minimum  Acceptable  Efficiency  level  =  — — —  x  100 

108  —  0.08o£/L 

Where 
SEL     —     the  standard  percent  efficiency  level  from  NEMA  Standard  TP  1. 

Note:  The  Minimum  Acceptable  Efficiency  level  calculation  is  based  on  an  8%  tolerance  on  total  loss  at  the  load 
levels  considered  for  the  Efficiency  levels  specified  in  NEMA  TP-1;  i.e.  no  individual  unit  shall  be  considered 
acceptable  if  its  measured  losses  exceed  the  allowance  by  more  than  8%. 
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Table  Bl: 

Sample  size  n 

t  at  95%  confidence  level 

Sample  size  n 

t  at  95%  confidence  level 

2 

6.314 

11 

1.812 

3 

2.920 

12 

1.796 

4 

2.353 

13 

1.782 

5 

2.132 

14 

1.771 

6 

2.015 

15 

1.761 

7 

1.943 

16 

1.753 

8 

1.895 

17 

1.746 

9 

1.860 

18 

1.740 

10 

1.833 

19 

1.734 

20 

1.729 

To  demonstrate  compliance  with  the  Efficiency  standard,  proceed  as  follows: 


Step  1.  Calculate  the  Total  Allowed  KVA  input: 


TAI  =  Y1 


Lj  kVAj 
Vi 


Where 
i 

kVAi 

Vi 
Li 


=     1,2,3,4,... 

=     kVA  ratings  of  various  transformers  included  in  a  production  batch 

manufactured  in  180  days. 
=     Specified  Efficiency  Level  in  TP  1  for  transformer  rating  kVAi 
=     Per  unit  load  at  which  the  efficiency  is  specified  per  TP  1 


Step  2.  Calculate  the  Total  Measured  kVA  input: 


TMI  =  J2 


Lj  kVAj 

Vmi 


Where 

i         =  1,2,3,4,... 

Ty^j     =  Measured  Efficiency  Level  for  the  transformer. 

Li       =  Per  unit  load  at  which  the  efficiency  is  specified  per  TP  1 


Step  3.  If  TMI  is  equal  to  or  less  than  TAI;  the  compliance  of  the  production  batch  has  been  demonstrated. 


7.1.2  Compliance  Demonstration  Through  Tests  on  a  Statistically  Valid  Sample: 

The  manufacturer  may  choose  to  demonstrate  the  comphance  of  a  plurality  of  units  by  a  random  sampling  of 
the  units  of  each  kVA  rating  produced  in  a  period  of  180  days.  Statistically  valid  numbers  of  units  but  not  less 
than  5  shall  be  drawn  on  a  monthly  basis  from  the  units  of  each  kVA  rating  produced  during  this  period  for 
testing.  This  will  assure  the  randomness  of  the  samples  (30  units  minimum). 

All  the  units  drawn  in  180  day  period  shall  be  tested  for  computing  the  mean  efficiency  of  each  kVA  rating. 
None  of  individual  units  in  a  sample  shall  be  considered  acceptable  if  its  measured  losses  exceed  the  allowance 
by  more  than  8%. 

It  is  the  responsibility  of  the  manufacturer  to  assure  through  adequate  quality  control  procedures  and/or  random 
testing  that  the  conformance  of  various  kVA  rating  transformers  is  maintained. 

For  a  random  sample  to  be  statistically  valid,  a  minimum  number  of  units  n  in  the  sample  must  be  tested  to 
cissure  that  the  standard  deviation  of  the  test  results  is  no  more  than  the  standard  deviation  S  of  the  population 
with  95%  confidence.  The  minimum  sample  size  shall  be  determined  as  follows: 

n  =  (tSK)^ 
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where 

108  -  0.085£;L 


K  = 


SEL{8  -  0.08SEL) 

and  t  Statistic  is  determined  from  Table  Bl  corresponding  to  sample  size  of  n  at  95%  confidence  level. 
To  demonstrate  compliance  with  this  standard,  proceed  as  follows: 

Step  1.  Choose  a  sample  size  of  ni  units  (5  min.) 

Step  2.  Compute  the  mean  Xi  and  standard  deviation  5i  as  follows: 

Xi  =  —  /  ^Xj, 
rii  ^-^ 


Where 

Xi     —     The  average  efficiency  of  the  first  sample. 

Xi     —     The  efficiency  of  the  unit  i 

Til      —     The  number  of  units  in  the  first  set  of  samples  (the  subscript  refers 

to  the  sample  number) 
S\      =     The  computed  sample  standard  deviation  of  the  first  sample 

Step  3.  Calculate  the  minimum  sample  size  n  as  follows: 

n  =  [txSxKf 

Where  t\  Statistic  is  chosen  from  Table  Bl  corresponding  to  the  sample  size  n\. 

Step  4.  If  n  <  Til,  the  sample  size  is  adequate  to  yield  the  acceptable  standard  deviation.   Proceed  with 
Step  6.  Otherwise,  test  additional  units  and  increase  the  sample  size  to  n2  such  that: 

n2  >  n,  where  n^  is  the  total  number  of  units  tested. 

Step  5.  Repeat  Steps  2  and  3  until  each  sample  size  for  each  kVA  rating  produced  is  larger  than  the 
minimum  sample  size  n. 

Step  6.  Calculate  the  average  efficiency  r\mi  of  all  the  samples  tested  in  180  days  for  each  rating  kVAi 
manufactured  within  this  period. 

Step  7.  Calculate  the  Total  Allowed  kVA  input: 


TAI^Y. 


Vi 


Where 
i  =     1,2,3,4,... 

kVAi     =     kVA  ratings  of  various  transformers  included  in  a  production  batch 

manufactured  in  180  days 

r]i  =     Specified  Efficiency  Level  in  TP  1  for  transformer  rating  kVAi 

Li  =     Per  unit  load  at  which  the  efficiency  is  specified  per  TP  1 

Ni         =     Total  number  of  units  produced  with  rating  kVAi 

Step  8.  Calculate  the  Total  Measured  kVA  input: 

Ni  Li  kVA, 
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Where 
i  =     1,2,3,4,... 

kVAi     —     kVA  ratings  of  various  transformers  included  in  a  production  batch 

manufactured  in  180  days 

rjj^i        =     Measured  efficiency  Level  for  transformers  rated  kVAi 

Li  =     Per  unit  load  at  which  the  efficiency  is  specified  per  TP  1 

Ni         =     Total  number  of  units  produced  with  rating  kVAi 

Step  9.  If  TMI  is  equal  to  or  less  than  TAI;  the  compliance  of  the  production  batch  has  been  demonstrated. 
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Appendix  C 
A  sampling  plan  for  enforcement  testing 

The  following  sampling  plan  is  adapted  from  the  Sampling  Plan  for  Enforcement  Testing  contained  10  CFR 
Part  430.  The  plan  is  similar  to  that  proposed  for  electric  motors  [18]. 

Step  1.  The  first  sample  size  (ni)  must  be  four  or  more  units. 

Step  2.  Compute  the  mean  (Xi)  of  the  measured  energy  performance  of  the  ni  units  in  the  first  sample  as 
follows: 


1       ii-i 

Xi  =  -y2xi,  (ci) 


1=1 


where  Xi  is  the  measured  efficiency  of  unit  i. 


Step  3.  Compute  the  sample  standard  deviation  (^i)  of  the  measured  efficiency  of  the  ni  units  in  the  first 
sample  as  follows: 

5i  =  ./n=i(^--^^)'.  (C2) 

V  ni  -  1 

Step  4.  Compute  the  standard  error  {SE{Xi))  of  the  mean  efficiency  of  the  first  sample  as  follows: 

SE{X^)  =  -^.  (C3) 


Step  5.  Compute  the  lower  control  limit  [UCLi)  for  the  mean  of  the  first  sample  using  the  applicable  rated 
efficiency  {RE)  as  the  desired  mean  as  follows: 

UCLi  =  RE-  tSE{Xi).  (C4) 

Here  t  is  the  2.5  percentile  of  a  i-distribution  for  a  sample  size  of  ni  and  yields  a  97.5  percent 
confidence  level  for  a  one-tailed  i-test. 

Step  6.  Compare  the  mean  of  the  first  sample  (Xi)  with  the  lower  control  limit  (UCLi)  to  determine  one 
of  the  following: 

(i)  If  the  mean  of  the  first  sample  is  below  the  lower  control  limit,  then  the  basic  model  is  in 
noncompliance  and  testing  is  at  an  end. 

(ii)  If  the  mean  is  equal  to  or  greater  than  the  lower  control  hmit,  no  final  determination  of 
compliance  or  noncompliance  can  be  made;  proceed  to  Step  7. 


Step  7.  Determine  the  recommended  sample  size  (n)  as  follows: 

(C5) 


n  = 


i5i(108-0.08i?JE;)"'^ 


RE{8  -  OMRE) 

where  Si  and  t  have  the  values  used  in  Steps  4  and  5,  respectively.  The  factor 

108  -  0.08RE 
RE{8  -  OMRE) 

is  based  on  a  8  percent  tolerance  in  the  total  power  loss  at  and  fixed  output  power. 
Given  the  value  of  n,  determine  one  of  the  following: 

(i)  If  the  value  of  n  is  less  than  or  equal  to  rii  and  if  the  mean  energy  efficiency  of  the  first  sample 
(Xi)  is  equal  to  or  greater  than  the  lower  control  limit  (UCLi),  the  basic  model  is  in  compliance 
and  testing  is  at  an  end. 
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(ii)  If  the  value  of  n  is  greater  than  n-i ,  the  basic  model  is  in  noncompliance.  The  size  of  a  second 
sample  n2  is  determined  to  be  the  smallest  integer  equal  to  or  greater  than  the  difference  n  —  rii. 
If  the  value  of  122  so  calculated  is  greater  than  20  —  ni,  set  712  equal  to  20  —  ni. 

Step  8.  Compute  the  combined  mean  {X2)  of  the  measured  energy  performance  of  the  ni  and  n2  units  of 
the  combined  first  and  second  samples  as  follows: 

-.  ni+n2 

Step  9.  Compute  the  standard  error  {SE{X2))  of  the  mean  efficiency  of  the  ni  and  n2  units  in  the  combined 
first  and  second  samples  as  follows: 

SEiX2)  =  -7==-  (C7) 

(Note  that  Si  is  the  value  obtained  above  in  Step  3.) 
Step  10.  Set  the  lower  control  limit  {UCL2)  to, 

UCL2  =  RE-  tSE{X2),  (C8) 

where  t  has  the  value  obtained  in  Step  5,  and  compare  the  combined  sample  mean  {X2)  to  the  lower 
control  limit  {UCL2)  to  find  one  of  the  following: 

(i)  If  the  mean  of  the  combined  sample  {X2)  is  less  than  the  lower  control  limit  {UCL2),  the  basic 
model  is  in  noncompliance  and  testing  is  at  an  end. 

(ii)  If  the  mean  of  the  combined  sample  {X2)  is  equal  to  or  greater  than  the  lower  control  limit 
{UCL2),  the  basic  model  is  in  compliance  and  testing  is  at  an  end. 


MANUFACTURER-OPTION  TESTING 

If  a  determination  of  non-compliance  is  made  in  Steps  6,  7  or  11,  above,  the  manufacturer  may  request  that 
additional  testing  be  conducted,  in  accordance  with  the  following  procedures. 

Step  A.  The  manufacturer  requests  that  an  additional  number,  ns,  of  units  be  tested,  with  n^  chosen  such 
that  Til  +  n2  +  ^3  does  not  exceed  20. 

Step  B.  Compute  the  mean  efficiency,  standard  error,  and  lower  control  limit  of  the  new  combined  sample 
in  accordance  with  the  procedures  prescribed  in  Steps  8,  9,  and  10,  above. 

Step  C.  Compare  the  mean  performance  of  the  new  combined  sample  to  the  lower  control  limit  {UCL2)  to 
determine  one  of  the  following: 

(a)  If  the  new  combined  sample  mean  is  equal  to  or  greater  than  the  lower  control  limit,  the  basic 
model  is  in  compliance  and  testing  is  at  an  end. 

(b)  If  the  new  combined  sample  mean  is  less  than  the  lower  control  limit  and  the  value  of  ni  +n2  +n3 
is  less  than  20,  the  manufacturer  may  request  that  additional  units  be  tested.  The  total  of  all 
units  tested  may  not  exceed  20.  Steps  A,  B,  and  C  are  then  repeated. 

(c)  Otherwise,  the  basic  model  is  determined  to  be  in  noncompliance. 
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Computational  algorithms 


Compliance  testing  under  10  CFR  Part  430  (Method  I) 

Let  xi,X2,.  ■  ■  ,Xn  be  measured  losses,  with  sample  mean  x  and  sample  standard  deviation  s.  In  a  test  of 
compliance,  we  require  that 

X  <k  (Dl) 

and 

x  +  ts/^/n<{l  +  e)k,  (D2) 

where  t  denotes  the  appropriate  percentile  of  a  Student-^  distribution  with  u  =  n  —  1  degrees  of  freedom,  and  d 
is  a  small  positive  number  (typically,  6  =  .03).  Assume  that  the  data  {xj}^^  are  an  independent,  identically- 
distributed  sample  from  a  normal  (Gaussian)  distribution  with  population  mean  fi  and  population  standard 
deviation  a. 


The  probability  of  compliance  is  given  by  the  expression 

t2 


P{a,  b)  =  ^  f^  e--y'/\l  \'^{a  +  b-yf]dy,  (D3) 


where 


a  = 


k-U       „„J       u  —  6k 


and     b  =  ^.  (D4) 


In  this  expression,  xtM  is  the  probability  that  a  x^  random  variable  Vu  having  u  =  n  —  1  degrees  of  freedom 
is  less  than  u;  that  is 


Pr(K  <  u)  =  xliu)  -  ^^  £  z-'/'-'e-^/'dz, 


(D5) 


which  is  a  function  easily  expressed  and  calculated  in  terms  of  an  incomplete  F-function.  Function  (D5)  can  be 
evaluated  numerically  using  a  wide  range  of  public  domain  software.  Gauss-Legendre  quadrature  is  adequate 
for  the  calculation  of  (D3),  and  it  is  sufficient  to  use  /x  —  ba /y/n  for  the  lower  bound  of  the  numerical  integral. 

The  limits  of  jp(a,  b)  as  a  goes  to  zero  or  infinity  are  of  particular  interest;  we  consider  these  in  turn 

Limit  of  small  a:  As  cr  — >  0,  6  — >■  oo.  If  o  is  allowed  to  go  to  infinity  as  well,  then  p{a,b)  ->  1,  which  isn't 
useful.  So  we  require  that  6  -^  oo  and  that  a  remains  finite;  that  is 

—DO  <  lim  =  q  <  Qo.  (D6) 

If  this  condition  holds,  then 

limp(a,6)     =     .[^r    e-^y'/'dy 
T^o  V  27r  J_^ 

-y/nq 


-=  /        e-^  /2  =  $(v^g)  =  a, 
y  2,11  J-oo 


where  $(z)  denotes  the  probability  that  a  standard  normal  random  variable  is  less  than  z,  and  0  <  a  <  1  is  a 
compliance  probability  which  identifies  a  compliance  probability  contour,  in  the  {fx,  a)  plane,  whose  asymptotic 
behavior  we  are  investigating.  Hence,  if  Za  denotes  the  lOOa  percentile  of  a  standard  normal  random  variable 
(that  is,  ^{za)  =  a),  then 

q  =  Zc/y/n.  (D7) 
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Asymptotically,  as  cr  — >^  0,  the  a  contour  of  compliance  probability  is  linear;  to  be  specific, 

fj,  ~  k  -  Za(T/\/n.  (D8) 

We  could  have  guessed  this  result  by  reasoning  that  as  a  -)•  0,  s  ^  0,  and  condition  (D2)  must  always  hold.  So 
we  need  only  be  concerned  with  condition  (Dl),  and  we  require  that 

Pv{x  <k)  =  a^ 

^    f X  —  a        k  —  u\ 
Pr     -j-^  <  -r^     =  Q  ^ 
\al-Jn       olyjn) 

k  —  fi  +  Zacr/y/n. 

Limit  of  lEirge  a:     As  cr  ^  oo,  6  ^  0.    If  a  ->  0,  then  p{a,b)  ->  0  ii  k  >  u,  p{a,b)  ->  1  if  A;  <  //,  and 
p{a,b)  -^  1/2  ii  k  —  fi.  This  is  not  particularly  interesting  or  realistic,  so  we  require  that 

lim  tzJ^  =  y^  (D9) 

<T-400  (T 


for  finite  v.  It  follows  that 


lim  p(a,6)  =  ^fj--y'/\l  ["^{v-y)']  dy.  (DIO) 


Let  h  =  V  —  y,  and  note  that 

dh 


limp(a,6)     =     ^ l^ '-""^''^'^  Xl  {^h') 
y  Jo 


V27n 

For  the  limiting  behavior  of  the  lOOa  percent  contour  in  the  (//,  a)  plane,  we  must  solve  the  transcendental 
equation 

*       /"°°e-teH\2(a:2)d3;  =  a  (Dll) 

Jo 


V2Tru 
for  V.  The  contour  will  be  asymptotically  linear,  i.e.,  as  cr  ^  oo 

H~k-va.  (D12) 

This  asymptotic  result  could  also  be  derived  by  reasoning  that,  in  the  limit  of  large  a,  s  will  almost  certainty  be 
large  and  x  <k  will  hold  automatically,  provided  that  condition  (D2)  is  satisfied.  So  the  compliance  probability 
is  determined  in  this  limit  in  terms  of  the  second  condition  alone,  which  leads  to  the  result  developed  in  this 
subsection. 

Derivation  of  p(a,  b):  Under  a  normal  distribution  model,  the  sample  mean  and  standard  deviation,  x 
and  5,  are  statistically  independent.  The  sample  mean  has  a  normal  distribution  with  mean  n  and  standard 
deviation  a  jy/n.  The  sample  standard  deviation  is  proportional  to  the  square  root  of  a  x^  random  variable, 
with  proportionality  constant  oj^/v. 

It's  easy  to  see  that  the  probability  of  compliance  can  be  expressed  as 

Pr(x  <  A;  and  X  +  islsfn  <  (1  +  B)k)  =  Pr  (  x  <  A;  and  s  <  ^    ^/     ~^l  •  (D13) 
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Because  of  independence  (which  holds  only  under  a  normal  model),  s  has  the  same  probability  distribution 
whatever  the  value  of  x.  So  we  condition  on  x  taking  on  all  possible  values  — oo  <  a;  <  oo,  and  integrate: 

Pr  U  <  A;  and  s  <  ^  ^ 


Pr  (  fc  >  x  and  s  < j^ Pr(x  =  x)dx  = 

r  Pv{k  >  x)  Pr  (s  <  il±3^^\  pi.(s  =  x)dx. 


Note  that  we  can  write  the  joint  probability  distribution  as  a  product  because  of  independence.  Substituting 
expressions  for  the  normal  and  y/)^  distributions  into  the  above  expressions  and  simplifying  leads  to  p{a,  b)  as 
given  in  (D3). 

Testing  under  TP  2 

Assume  that  the  random  variables  Yi  are  normal  with  mean  /x  and  standard  deviation  a.  Since  we  will  assume 
that  /i  and  a  can  be  regarded  as  approximately  known  from  previous  data,  we  can,  without  loss  of  generality, 
employ  the  standardized  sample  Xi  =  {Yi  —  fjL)/a,  having  order  statistics  X(j)  =  (Y(i)  —  fJ,)/(7. 

Then  the  probability  of  being  found  in  compliance  under  the  TP  2  sampling  plan  can  be  shown  to  be 

P  =  1  -  [Fx,,,{t)  +  F^it)  -  F;,^,„x(*i,t2)]  .  (D14) 

The  function  Fx^^^{t)  denotes  the  CDF  of  X(i),  and  Fx{t)  denotes  the  CDF  of  X;  that  is 

Fx,„(0  =  Pr(X(i)<i)  =  l-(l-*(t)r, 

and 

Fxit)=Fr{X<t)  =  ^{y^t), 

where  $(•)  is  the  standard  normal  CDF,  which  is  defined  to  be  the  probability  that  a  normally  distributed 
random  variable  is  less  than  u,  that  is 

/u        —sl 
6         2 
dx. 
-oo  \/2n 


This  integral  may  be  calculated  efficiently  and  accurately  using  public-domain  routines. 
A  saddle-point  approximation  to  the  bivariate  CDF 

Fx^,,,x{ii,t2)  =  Pr(X(i)  <  ti  and  X  <  ^2) 

is  derived  by  Vangel  [8].  Let  (j){t)  denote  the  normal  density,  and  let 

^  ^       1  -  $(i) 
be  the  normal  hazard  function.  The  saddle-point  approximation  Fx.^.xi'ti^h),  for  ti  <t2,  is 

^  .    ,,       /!'oo  ^V^h)A{t)dt  +  /-  $  {V^  [h  +  ^(Ht)  -  t)]  }  A{t)dt 

Fx,.,Atuh) Sr^A(t)dt  '  ^^^^^ 

A(t)     =     /i-("-^) (0  exp  I  ^"^  ~  ^^    [hit)  -  tf  +  (n  -  1)^  [h{t)  -  ^]  |  y^l  -  h?{t)  +  th{t), 

where  t*  is  the  (unique)  solution  to  the  equation 

T7  —  1 

[h{h)-t,]  =  t2-h.  (D16) 

n 
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Enforcement  testing 

The  probability  of  demonstrating  compliance  by  testing  under  the  Sampling  Plan  for  Enforcement  Testing  can 
be  calculated  using  straightforward  numerical  integration. 

In  the  following  expressions,  ni  >  4  denotes  the  minimum  sample  size  specified  in  the  sampling  plan,  and 
712  =  20  is  the  maximum  sample.  In  order  to  simplify  the  equations,  ni  —  1  is  represented  by  «/,  and  t  is  the 
97.5th  percentile  of  the  Student-^  distribution  for  the  sample  size  ni. 


The  probability  of  compUance  is 


"2  fKi  +  l 


# 


{100  -  fi)y/i  -  tx 


x"     e   '2^dx, 


where  the  limits  of  integration  are  Km  =  0, 

LT  -  100 


Kj  — 


t 


\/i  —  1  for  i  =  ni  +  1, 


,^2, 


and  Kn2+i  =  oo,  and  the  loss  tolerance,  LT,  is  a  percentage. 
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